How Neural Circuitry is Laid Down

In thinking about hidden layers, it’s important to distinguish between the routine efficiency and power of a good network, once that network has been set up, and the difficult issue of how to set it up in the first place. That difference is reflected in the difference between playing the piano (or, say, riding a bicycle, or swimming) once you’ve learned (easy) and learning to do it in the first place (hard). Understanding exactly how new hidden layers get laid down in neural circuitry is ...

 The Internet as a Brain

The brain is one of the most complex networks in the world, with more neurons than there are stars in the galaxy. Its hardware is a complex network of neurons; its software a complex network of memories. And so too is the Internet a network. Its hardware is a complex network of computers; its software a complex network of websites. There is a lot we can learn from the brain and it can tell us where the Internet is headed next. [...] In practice, the Internet is clunkier, slower, and smaller...